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C^ ' Abstract 



The starting point is a continuous family of bounded operators in a Hilbert space, indexed by a 
locally compact space. A certain square integrability condition is required with respect to a given 
. Radon measure. Then one constructs and studies a symbolic calculus, various Gelfand triples with 

■^^ ' nice algebraic properties as well as coorbit spaces of vectors and symbols. The aim is to unify within 

Mh . the coorbit theory recent global pseudodifferential theories going beyond the group theoretic point 

of view. [^ 



1 Introduction 



This article, as many others, is concerned with symbolic calculus, under certain circumstances also 
^ I called quantization, seen as a systematic way to associate operators in some (infinite-dimensional) 

t*^ ' vector space with functions defined in a suitable related set S endowed with a topological structure 

^J^ I and with a measure. We have in mind mainly operators acting in a Hilbert space TL, but other type 

of topological vector spaces will also be considered. 

On the other hand, and this is the main novelty of the work, we are not going to assume that S 

r_j ' is a locally compact group or that it has some smooth structure. Even if E happens to be a group, 

we are not trying to build the symbolic calculus on some group representation (usual or projective) 
of S by operators in 7i. The main reason to undertake such a task is that certain generalized forms 
of global pseudodifferential calculi invented recently [2l|3l|4l[5l[6l[7l[35l[38l[39l|4ll|43], even if using 
group theory, are more and more remote of of being just the integrated form of a given projective 

S^ I representation. 

$-( < 

C^ , It is our intention to present a unified and systematic framework for such a general symbolic 

calculus and especially to show that it is a good background for introducing and studying coorbit 

spaces of vectors and symbols. 

Among the different strategies to start and justify a symbolic calculus, there are two, dual to each 
other, that we are going to privilege. They appeared many times before, but we would like to make 
a systematic use, in a framework as general as possible. 

The first one, inspired by Weyls quantization procedure, consists in associating to each point s of 
the space E a bounded linear operator 7r(s) in Ti. This mapping s i— > 7r(s), while not supposed to be 
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unitarily valued or to possess group-like properties, would benefit from some regularity requirements. 
Boundedness and weak continuity are good properties, but a square integrability eondition with 
respect to some measure /z on E (generalizing the notion of square integrable representation of a 
group) is the best starting point. Then operators !!(/) are associated to suitable functions / on E 
by integration techniques, and square integrability plays an important role in identifying Hilbert- 
Schmidt operators as corresponding by quantization to i^-functions. Even rather simple examples 
show that not all the elements in L^{J^,fi) need to be involved. 

The dual approach is to give a priori the symbols (functions defined on E) of all the rank-one 
operators. Then the symbols of more general operators are obtained by superposition, modelled by 
integration on E , followed eventually by other extension techniques. If suitably implemented, the 
construction is essentially the inverse of the one described in the previous paragraph. But this is 
achieved only after the formalism is extended; the operators 7r(s) are almost never rank-one (or at 
least Hilbert-Schmidt). 

Many classes of operators form *-algebras under operator multiplication and taking adjoints. 
Clearly, it is desirable to use the quantization to induce isomorphic versions of these *-algebras 
on classes of symbols. As a matter of fact, due to the square integrability assumption, one gets 
compatible scalar products on the *-algebras making them Hilbert algebras. This already makes 
available extension techniques permitting the treatment of symbols not associated to Hilbert-Schmidt 
operators. But most of the known examples strongly suggest the existence of an extra mathematical 
structure, resulting in Gelfand triples both at the level of vectors and at the level of symbols, suitably 
interconnected. One could simply think at the role played in pseudodifFerential theory by the Schwartz 
space and its dual, the space of tempered distributions. Another example, leading to Banach space 
Gelfand triples, is the Segal-type Feichtinger algebra, available on locally compact groups. In our 
general framework we are going to indicate a systematic way to construct Gelfand triples connected to 
the symbolic calculus associated to the family {tt{s) \ s S E}; it will turn out to have a rich algebraic 
content. The emerging objects will also offer a convenient framework for the coorbit space theory 
developed in the second part of the paper. 

Very roughly, in a coorbit theory one defines spaces endowed with algebraic or topological structure 
(mainly Banach spaces) by imposing conditions on suitable transformations applied to its elements. 
We do not feel competent to give an overview, a historical presentation or exhaustive references for 
this topic, also related to (or even including) wavelet theory, so the discussion will be restricted to a 
framework as close as possible to our setting. 

The basic pattern and motivation for us was the fundamental article |17j of Feichtinger and 
Grochenig, which constructed coorbit spaces starting with an integrable, irreducible strongly con- 
tinuous unitary representation tt : G — > B(H) of a locally compact group G in a complex separable 
Hilbert space 7^. This article unified a lot of previous work on function spaces and had a great 
infiuence on the subsequent development of the field. Among many others, it contains as a particu- 
lar case the theory of modulation spaces previously developed by Feichtinger [HI [15] , in a classical 
function space context and also in connection to the Schrodinger representation of the Heisenberg 
group. Among the many developments we cite [HI [TSl [221 HI] • Recent contributions as [HJ [33] (see 
also references therein) extend the theory of coorbit spaces much beyond group theory; they rely on 
frames {w(s) | s G E} C H indexed by a locally compact space E endowed with a Radon measure 
with respect to which a square integrability condition is required. Our "coorbit spaces of vectors" are 
essentially covered as a rather particular case, setting w{s) := tt{s)*w for some fixed element w € H. 
So our main contribution lies in another realm, involving " coorbit spaces of symbols" . 

More recent work ([i[l3[2l[25l[Ml[2ll[Ml[2a[3i[Ml[33|[4i[4i[50|[5ll[5l[57]and many others) , 
triggered by contributions of Sjostrand [46[[47], showed the great importance of modulation spaces in 
the theory of pseudodifferential operators on R" or on Abelian locally compact groups. On one hand. 



"modulation spaces of vectors" constitute convenient spaces on which pseudodifferential operators 
naturally apply, providing a rich setting going beyond the usual formalism involving typically Hilbert 
and Schwartz spaces. But, more importantly, a similar strategy leads to introducing "modulation 
spaces of symbols" . spaces of functions or distributions defined in phase-space (R" x R" would be 
the typical example), transformed by the pscudodifFercntial prescription into operators. These new 
spaces of symbols are often better-suited and simpler to use than the traditional (Hormander-type) 
spaces used in pseudodifferential theory, bringing to the whole setting a harmonic analysis flavor. 

As mentioned above, the Weyl calculus [50] has been extended to incorporate variable magnetic 
field on M" and on nilpotent Lie groups. Corresponding more general modulation spaces of symbols 
has been introduced and examined in [5l [Tj |39] . Trying to figure out a general setting, in |40] parts of 
a coorbit theory has been constructed for suitable abstract composition laws defined on the Schwartz 
space oS^(M" x R"). However, the treatment in [3D] still relies on the simple choice E = R" x R" and 
representations by operators in Hilbert or Frechet spaces were not taken into accont; among others, 
the present article tries to remove these drawbacks. 

For various reasons (space, time, ignorance) various closely connected topics has been left aside; 
this includes atomic decompositions, spectral invariancc, compactness criteria, Schatten-class prop- 
erties, non-square integrablc families, Berczin-Tocplitz operators. Some of these will be treated in a 
subsequent work, as well as a series of examples complementing the rather brief Section 3. 

We are going to indicate some notions, conventions and notations in a short section to which the 
reader could return when needed. Each of the other chapters starts with a brief presentation. 

Conventions and notations 

If E is a locally compact space (tacitly assumed to be HausdorfF), we set i?C(S]) for the C*-algebra 
of all bounded continuous complex- valued functions on E and Co(E) for the ideal composed of the 
continuous functions that decay at infinity. If there is a measure ^ on E and g £ [1, oo], we denote 
by ^''(E; ^i) the usual Lebesgue space of order q on (E, ^). 

For two Hausdorff locally convex spaces £ and F, we are going to write S ® J- for the algebraic 
tensor product. When endowed with the projective topology, it will be denoted by £ ®pj- and its 
completion in this topology by £®pT. Analogously, £®iF will be the completion of £ ®iJ-, which is 
£ ® T endowed with the injcctive topology. 

Under the same assumptions on £ and J-, we denote by B(f , T) the vector space of all linear 
continuous operators from 5 to J^ and use the abbreviation B(£) := ]B(f,f). Then £' := B(f , C) is 
the (topological) dual of £. 

Since many of our objects will be Hilbert algebras, we give the abstract definition |10j . 

Definition 1.1. A Hilbert algebra is a * -algebra {s/,^,'^) endowed with a scalar product {■,■) : 
£/ X £/ ^ C such that 

1. one has {g* , f*) = {f,g) for all f,g eA, 

2. one has {f#g,h) = {g,f*#h) for all f,g,h G A, 

3. for every g £ s^ , the map Lg : £/ -^ jz/, Lg{f) := g^f is continuous. 
4- £/^£/ is total in £/ . 

A complete Hilbert algebra is called an iJ*-algcbra. 

Clearly one also has (f^l^g, h) ~ (/, h^g"^) for all f,g,hE jz/ and the map Rg : jz/ — > jz/ given 

by Rg(/) := /#3 is also continuous; therefore £/ x j2/ -^ s/ is separately continuous. 

To give some basic examples, let us fix a separable complex Hilbert space H ; by convention the 
scalar product (•, ■) is anti-linear in the second variable and we denote by Ti the conjugate space 



of Ti . By Ricsz Theorem, the dual Ti' of TL is canonically antihnearly isomorphic to H, so there 
is a hnear isomorphism permitting the identification of H with H' . Recall that the space B2('H) of 
Hilbert-Schmidt operators on TL forms a *-idcal in M{TL) and a Hilbert space with the scalar product 
(S, T)]u^(„) := Tr (ST*). Actually B2(H) is a iJ*-algebra; the subspace M2('H)M2i'H) (coinciding with 
the *-ideal 'Ri{'H) of all trace-class operators) is dense in M2{TL) . 

Let us denote by A the canonical isomorphism between the Hilbert space tensor product H® H 
(the Hilbert completion of the algebraic tensor product T-L^T-i) and B2('H), sending u® v into the 
rank one operator A(u (g) u) = A„^„ := {■,v)u. It can be seen as an isomorphism of _ff*-algebras in 
an obvious way. Its restriction A : 7^ H — > F(7^) is a Hilbert algebra isomorphism between the 
algebraic tensor product and the finite rank operators. We record for further use some relations valid 
for u, V, u' , v' G H and S G 



K..V = ^v,u , Tr (A„,„) = (?/, v) . (1.2) 

Very often, besides the norm topology of a Hilbert algebra £/ (deduced from the scalar product), 
there is another finer locally convex topology. A convenient situation is described at point 2. of the 
following definition; point 1 is a standard concept. 

Definition 1.2. 1. A Frechet *-algebra is a * -algebra (i/, #,^) with a Frechet locally convex 
space topology 3" such that the involution s^ ^ f ^f f^ € £/ is continuous and the product 
£/ X £/ 3 {f , g) ^ f^g G £/ is separately continuous. 

2. A Frechet-Hilbert algebra {jz/, #,'^ , 3, (•, •)) is both a Frechet * -algebra and a Hilbert algebra, 
the topology .'^ being assumed finer that the norm topology associated to the scalar product. 

There will be plenty of examples in the main body of the text, but for insight just think of 
the Schwartz space S^{M.™) with its well-known Frechet topology, the ^^-scalar product and the 
involution "^ given by complex conjugation (eventually composed with some symmetry of R'"). The 
composition law # could be point-wise multiplication or convolution, or maybe the Weyl product or 
some twisted convolution, at least when m = 2n . 

2 A generalized symbolic calculus 

The purpose of the fist chapter is the construction of the symbolic calculus associated to the data 
(S, fi, TT, Ti, G) ■ We denote by S a Hausdorff locally compact space endowed with a Radon measure 
/i. It serves as a family of indices for a set of bounded operators {tt{s) | s G S } in the Hilbert space 
H ; in a first stage the second space G plays no role. We do not assume that 7r(s) is unitary and we 
do not ask anything about the product 7r(s)7r(t) for s,t G S . The map 7r(-) is assumed bounded and 
weakly continuous, but this is not used for all the constructions and results. The main requirement 
is relation (|2.2p . a square integrable condition extending a wide-spread related concept from group 
representation theory [T^ . 

The first purpose is to raise the family n, essentially by integration, to a correspondence / n- H(/) 
sending a closed subspace of ^^(E;/i) to the ideal of all Hilbert-Schmidt operators in H. Actually 
the fact that H is "an integrated form" of tt (in the spirit of group representation theory) is only 
seen a posteriori; the initial construction is just "an abstract nonsense" based on the tensor product 
point of view on Hilbert-Schmidt operators and the "representation coefficient" map $ (that will play 
a distinguished role all over the article). The three linear maps H, <I> and A (the third one defined 
above) are interconnected isomorphisms of _ff *-algebras. 



As a consequence of these isomorphisms, one also defines classes of trace-class, compact and 
boundcd-typc symbols forming Banach *-algebras; Radon measures on S can also be incorporated 
to the formalism. 

The first two sections of this first chapter have a lot in common with the nice and interesting 
recent articles [21 |3]. While we do not assume group-like, Hilbert-Schmidt or unitary properties 
for the operators 7r(s). our square-integrability assumption is too strong to allow the treatment of 
(projective) representations of non-unimodular locally compact groups. 

To make further progress, slightly more should be added. We introduce an extra Frechet space Q, 
continuously and densely embedded in %. We do not ask it to be invariant under the operators 7r(s), 
to be Banach (this would exclude the valuable Schwartz spaces) or nuclear (excluding Feichtinger 
algebras). Then duality and topological tensor product techniques start generating new spaces, 
organized in Gelfand triples [Ml [H] , as well as isomorphisms extending or restricting the already 
existing mappings H, <!> and A. Automatically these Gelfand triples have extra algebraic properties, 
compatible with the topologies, built on the ad hoc notion of Frechet-Hilbert algebra indicated in 
Definition 11.21 The large spaces of the triples will constitute a background both for the symbolic 
calculus and for the coorbit constructions. The last section of the chapter is dedicated to an extension 
of the involution and of the symbol composition law to a large subspace of this background, called 
the Moyal algebra in analogy with the approach to the pseudodifferential theory in Weyl form of [31] . 

We warn the reader that in many cases the quantization one gets by applying the general strat- 
egy must still be composed with extra transformations (isomorphisms mostly) to arrive to the most 
popular form. If E is an Abelian locally compact group, for instance, with Haar measure /i, one 
composes the quantization 11 with a Fourier transformation ^, getting the new but related quanti- 
zation a H- > Op(a) := n[g'(a)]. In some cases E is the product X x ^ between an Abelian locally 
compact group X and some other space 17, so composing with a partial Fourier transform is also an 
option. Changes of variables in E can also be taken into account, eventually involving some ordering 
issue as in the traditional pseudodifferential theories (Kohn-Nirenberg, Weyl, etc). Then it is easy 
to understand why the involution / i— >■ /*, corresponding to the adjoint at the level of operators, has 
no reason in general to coincide with complex conjugation. 

2.1 The //*-algebra ^2(S) 

Let us fix a Hausdorff locally compact space E and a Radon measure /i on E with full support. 
The complex Hilbert space % will always be separable and infinite-dimensional. We assume that 
TT : E — > B(H) is a bounded, weakly continuous map. Then one defines the sesquilinear mapping 

(f)'" = (l):HxH^BC{^), 0„,„(s) :=(7r(s)u,w) . (2.1) 

It extends concepts as representation coefficients, wavelet transform or Short Time Fourier Transform. 

Hypothesis 2.1. The mapping (j)'" extends to an isometry ^^^ = $ : %®'H — > ^^(E;/i) = ^^(E) . 

Remark 2.2. This hypothesis, tacitly assumed all over the article, is equivalent to requiring the 
relation 

[ d,i{s)\{ir{s)u,v)\^^\\u\\^\\v\\\ yu,ven. (2.2) 

This docs not happen, for instance, if 7r(s) = 1-^ for all s. To achieve (|2.2p with coefficient 1, a 
renormalization of the measure ^ may be used if necessary. The family {tt(s)u | s e E } will be a 
tight continuous frame for every u £ TL, with frame constant C = || u |p. 

We do not ask the totality of the family {(j)u,v = ^{u <S)v)\s G Y.} in ^^(E). Consequently, there 
is a (maybe proper) closed subspace ■^2(S) := $ (Ji^'H) of .jSf^(E) which is unitarily equivalent to 



Ti^'H and (hence) with B2(7^). This space .^2(2) is the closure in ^^(I]) of the subspacc ^{H'^'H) . 
Clearly, there exists a Hilbert space isomorphism 11 := A o $~i : .^2(5^) — ^ ^2{T~l-) uniquely defined 

by 

n (</>„,!,) = A„,i, = (•,«)«, \fu,ve'H (2.3) 

and satisfying 



Tr[n(/)n(5)*] = (/,g)(j.) := / dA.(s)/(s) g(s) , V/,5e^2(S). (2.4) 

Proposition 2.3. For any f G ^2(2) one has in weak sense 

Uif)= fdfiis)fis)nisr, (2.5) 



nifr=d^i{s)f{s)7r{s). (2.6) 



Proof. li u,v E Ji one has 

(n(/)«,i;) =Tr[An(/K.] = Tr [n(/) A„,, ] 

= Tr[n(/)n(0„,J*] =(/,0,,„)(^) 

dfJ-{s)fis) (7r(s)*u,ij). 



Then the second formula follows from the first one. D 

By transport of structure one defines a composition law 

*:^2(S)x^2(S)^^2(S), /*.g:=n-i[n(/)n(.g)] (2.7) 

and an involution 

*:^2(S)^.!^2(S), r :=n-i[n(/)*]. (2.8) 

So, by Definition I l.li ^2(S) wi/Z &e a H* -algebra and H : ^2(S) — > B2('H) a H* -algebra isomorphism. 
Thus one has for all f,g,h € ^2i'^) 

(r,/)(S) = (5,/)(E) (2-9) 

and 

(/*.9,/i)(s) = (/,/i*g*)(E) = (5,r*/^)(s) ■ (2.10) 

The Hilbert subalgebra ^i{T.) := ^2(S) • ^2(2) is dense in ^2(2) and for any 9 e ^2(2) the maps 

^2(S)3/^Lg(/):=,9*/e^2(S), ^2(S)9/H^Rg(/):=/*,9e^2(S) (2.11) 

are continuous. Clearly L is a representation and R is an anti-representation. The (semi-finite) von 
Neumann algebras generated in B [^2(S)] by {Lg I5 e ^2(S)} and {Rg\g e ^2i^)} wiU be denoted, 
respectively, by -£(S) and SH(S); each one is the eommutant of the other [TU]. We are also interested 
in the *-morphism {L, R} : ^2(^)0^2(2) -^ B [^2(2)] given for f,g, h G ^2(2) by 

[{L,R}if ^ g)]h := f ^h^g = (If oRg)h= {Rg oLf)h. (2.12) 



We notice for further use the relations 

(0«i,Di,0«2,f2)(S) ^ ("l'^2) (u2,Wl) (2-13) 

and 

vahd for every w, ui, W2, w, wi, U2 G H , as well as 

/*0u,i,*ff = 0n(/)«,n(g)*«, V/,.g e ^2(S), M,u e 7^. (2.15) 

In particular, if || u || = 1, then 4>u,u is a self-adjoint projection, represented by 11 as the rank-one 
operator Xu,u- Also notice that ^i(S]) and ^2(S) are Banach *-algebras with the natural norms. 

2.2 Extensions and the explicit form of the composition law 

Now we extend the objects above. We define a new norm 

||-||^(S):^2(S)^M+, ||/||.^(s):=l|n(/)||B(«). (2.16) 

The completion of ^2(S) under this norm is a C*-algebra .^oo(S) containing ^2{'^) as a dense 
*-ideal (this one also endowed with the stronger Hilbert topology). Clearly 11 extends to a C*- 
algcbraic monomorphism 11 : ^^ooC^) -^ M{TL) with range n[^oo(S)] = Boo('H), the ideal of all 
compact operators in T-L. Then we denote by 3§{Y.) the multiplier C*-algcbra [56] of ^oo(S), which 
is isomorphic by a canonical extension of 11 with B(?^), which can be identified with the multiplier 
C*-algebra of Boo('^)- We keep the same notations • and * for the composition law and the involution 
on ^(S). Based on the constructions above, the elements of .^i(E) (.^2(S), ^oo(S)) will be called 
respectively trace-class (Hilhert- Schmidt, compact) sym,bols. For the elements of S§{Yi), to eliminate 
any possible confusion, we reserve the term operator-bounded symbols. 

The spaces .^g(E), g = 1, 2, cxo are still *-ideals in ^(S) and the scalar product (•, •)^,(5]) can be 
"extended" to sesquilinear forms 

(•, •)(5.) : ^i(I]) X ^(E) ^ C , (•, •)(5.) : ,^{Y) x SSi{Y.) -^ C . 

For this one simply sets (/, g)iY.) •" ^r [n(/)n((7)*] (definitions by approximation are also available). 
Note for / G .^i(S) and g £ .^(S) the inequality 

I (/, g)(s) I < II / lUi(s) II g ll.«(s) ^ II n(/) ||b,(w) || n(g) ||„(„) . (2.17) 

Due to the cyclicity of the trace, ii f,g,h e .^(S) and one of them belongs to 3§i (S) (or two of them 
belong to 3§2{^)), one has 

(/*g»(s) = (/>*3*)(S) = (3,r*/i)(s)- (2.18) 

Let us put Cs :— U^^ [^{s)*] G ^(S) for every s G S ; thus 4>u,v{s) = {u, U{es)v) for aU u, v and s 
and 

^(s)*=n(e,), 7r(s)==n(e:). (2.19) 

Proposition 2.4. For every f G ^i(S) one has 



(/,e.)(s)-/(.s), (/,e:}(j.)=/*(s), M-«-e. SGS. (2.20) 



Proof. By a direct computation using (|2.3p . (|l.ll) and (|1.2p one gets for every u,v £H, s S S 

((A«,-u,es)s = Tr[n((/)„,^„)7r(s)] = Tr [A„,„7r(s)] = Tr [A„,^(,,).i,] = (/!)„,„(s) , 

so the same is true for (/;„ „ replaced by any element g of the subspace $('H ® T-t) which is dense in 
^i(S). ' _ 

Assume now that a sequence {(?n}neN C <f>(?^ Cg) H) converges to / S ^i(S) with respect to the 
trace norm. Then for each s G S 

I (/' es)(E) - (.9n, e3)(s) I = |Tr [n(/ - g„)n{s)] \ 

<ll n(/-g„) ||bi(w) II 7r(.s) IIb(w) 
= c(.s) II /-.9„ ||.®,(s) — > 0. 

Since convergence in ^i(I]) implies convergence in ^^(E) which, in its turn, implies /i-almost every- 
where convergence of a subsequence, there is a //-negligible set M C S and a subsequence {^nfclfcsN 
such that for every s € 'S\M 

f{s) ^ lim .g„,(s) = lim (.g„,, e^)(5.) = {f,es)r^) ■ 
Then for s belonging to the same set s G XI \ Af one has 



(/, <)(s) = (e«, r )(E) = (/*. e.)(s) - /*(s) . 



D 



Corollary 2.5. For every f,g 6 ^i(S) one has 

dKs){f,es){s){es,9)(^] = {f,g)(^) ■ (2.21) 



'E 

Proof. Follows immediately from the proposition. D 

Now we can "compute" the symbol of a trace-class operator. 
Corollary 2.6. For T e Mi{'H) C B2(7^) one /ia.s 

[n"^(r)] (s) = Tr[r7r(s)], //-a.e. seE. (2.22) 

Proof. Let us denote for the moment by 11^"^^ the mapping defined at (|2.22p . It is enough to show 
that n(-i' [n(/)] = / hold ^-a.e. for every / belonging -SSiiT.) . 
But for /i- almost every s S E, one has by p.l9p and p.20p 

(n(-i) [n(/)]) (,s) = Tr [n(/)7r(s)] = (/, e,)(5,) = f{s) . 

u 

Corollary 2.7. For each S e MiCH) and each f G ^2(S) one has 

Tr[n(/)5] = / dfi{s)f{s) Tr [7r(s)*5] , (2.23) 

Tr[n(/)*5] = / dM(s)7RTr [^(s)5] . (2.24) 



Proof. One uses the definitions, the fact that 11 is unitary and formula (|2.22p : 

Tr[n(/)^] =(n(/),n[n-i(5*)])„^(„) = {f,ii-\s*))^^^ 



dMW/(s)[n-i(5*)](s)= / d^i{s)f{s)Tr[S*7^is)] 
dfi{s)f{s)Tr [nisyS] . 



IS 

The relation ()2.24p follows similarly. D 

Corollary 12 ■ 7l reenforces Proposition l2.3l which is recovered by taking 5 to be a rank one operator. 
Remark 2.8. One can also justify the relations 



/ = / dfi{s)fis) e„ r = / dKs).f{s) e* ; (2.25) 



for example, if g G ,^i(E), then 



dtJ'is)f{s) (e3,.g)(s) = / dti{s)f{s)g{s) = (/,.9)(s) • 

In general i^2(5^) is not a reproducing kernel Hilbert space; in particular cases the symbols {e^ | s G 
S} C M{T,) rarely belong to ^2(S). 

We give now explicit formulae for the algebraic structure 

Theorem 2.9. For any right approximate unit {Sn \ n G N} in Bi(?^) . 

1. If f £ I^i(T,), for fi-almost every 7' G S one has 



r(r)= lim d^iis)TT[nir)Tri.s)Sn]f{s). (2.26) 

^- If fi9 G ■^2(2), for ^-almost every r G S one has 

(/*g)(r)=lim [d^l{s)[d^i{t)Tr[■K{sy^{ty^{r)Sr.]f{s)g{t). (2.27) 

"^°°7e Je 

Proof. Both computations rely on Corollaries 12.61 and 12.71 One has for //-almost every r G S 

r(r)=Tr[n(/)*7r(r)]= lim Tr [n(/)*7r(r)5„] 



and 



lim / d^(s)Tr[7r(.s)7r(r)S'„]/(s) 



(/*g)(r)=Tr[n(/)n(.g)7r(r)]= lim Tr [n(/)n(.9)7r(r)5„] 
= hm /d/.(s)/(s)Tr[7r(s)*n(5)^(r)5„] 



= lim / dii{s)f[s) / d/i(i)3(0Tr [^(s)*^(t)*7r(r)5„] 



D 



Remark 2.10. We also need the map 

e : E X S^]B[/^2(S)], e(s,i)/:=ej*/*et, (2.28) 

doomed to satisfy 

7r(s)n(/V(t)*=n[e(s,i)/], Vs.ies, /g^2(s). (2.29) 

Notice the relation 

e*s*4>u,v*et = Q{s,t)(l)u,v = (j)T,(s)u,7T{t)v, ys,teE,u,veH, (2.30) 

which implies that 

e(s,i) = $o[7r(s)®7r(f)] o$-\ Vs,tGE. (2.31) 

Remark 2.11. Let ^(E) be the Banach space of all Radon bounded complex measures on E, seen 
alternatively both as functions on the Borel sets of E and as elements of the topological anti-dual 
of Co(E). Clearly every p £ ^(E) extends to an anti- linear continuous functional p : i3C(E) — > C ; 
we are going to use the notation {{p,f)) = J^ f dp for this "duality" (linear in p and anti- linear in 
/). On ^(E) the usual norm of an anti-dual coincides with the measure norm expressed as the total 
variation applied to the entire space E. Since for every u,v G H one has <j>v^u G ^2{'^) H BC(E), one 
can define Il{p) E M{H) in weak sense by 

{n{p)u,v) -.^ J dpis)(7r{sru,v) = ((p,(^(-)*«,«))) = ((p>.,„)). (2.32) 

Now it is also obvious that et coincides with the Dirac measure concentrated in t and that if p has a 
density g with respect to the initial measure p., then n(p) = n(g). The estimate 

II n(p) IIbch) < II p |U(E) sup II 7r(s) IIbch) 

is easy and certifies that ifi(E,/^) C ^(E) C ^(E). 

Remark 2.12. For various reasons (computational, tradition, physical motivation, etc) one might 
choose another realization of the formalism. For example, let ^ : ^^(E) — > J^ be a unitary mapping 
of ^^(E) onto some Hilbert space J(f. By composing with '^ the important mappings introduced 
above and by obvious transport of structure, one gets an equivalent symbolic calculus for elements 
in J^. Relevant formulae are 

*:=S^o$, Dp'' := Bo 5^1 (2.33) 

for the operators and 

a#b := 5 [{r'a) * (r'b)] , a* := ^ [(^"'a)'] (2-34) 

for the algebraic structure. The elements {zg '■= d (ss) | s G E} play a distinguished role. All the 
auxiliary constructions can be pushed on through ^ . 

In many situations there is enough structure to define a "dual phase space" E such that ^ := 
^^(E) and 5 is some general form of Fourier transform, so that the symbols of the resulting calculus 
will be essentially functions on E . We refer to Section [3] for such examples. 
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2.3 Prechet-Hilbert algebras and their Gelfand triples 

In most of the applications there is some supplementary structure which can be used to enrich and 
enlarge the formalism. Let t/ be a Frechet space continuously and densely embedded in "H; set 
a : Q ^f H for the embedding. We are going to show that such an extra data generates many new 
useful objects, even if we do not require 7r(s)t/ c Q for s S S . Assuming that Q is nuclear would 
simplify the overall picture, but we are interested not to loose the case of Banach spaces. 

Lemma 2.13. The projective tensor product Q®pQ is a Frechet space continuously and densely 
embedded in the Hilbert space H,® % . 

Proof. Clearly, Q®p Q is a, Frechet space. It is enough to embed it continuously and densely into 
Ti'Sip'H. The canonical mapping a (E) a : Q (E) G ^ "H <Ei H is linear and continuous when on both 
tensor products we put the corresponding projective topologies [53l Prop. 43. 6], so it extends to a 
linear continuous map a^pa : Q®pQ — > TL^pH- This map obviously has a dense range, and it is 
injective by [53l Ex. 43. 2]. By composing with the canonical injection 'H^pH =-> H^H , we get the 
linear continuous map a : Q®p Q — > T-L® H (injective and with dense image). D 

By a slight abuse of notation, we are going to treat C^ as a dense subspace of H and Q^p Q a,s a, 
dense subspace of hStZ. Let us set ^(E) := $ [^^pS] C ^2(2) C ^'^^) . 

Theorem 2.14. With the algebraic and topological structure induced from G^p Q and with the scalar 
product {■,-)cs)' ^^6 space $^(S) becomes a Frechet- Hilbert algebra (cf. Definition \1.2\) composed of 
trace-class symbols, continuously and densely embedded in 3§2{'^)- Its dual ^'(E) contains all the 
operator-bounded symbols. The restriction $ : G<EipG — > ^(E) is an isomorphism of Frechet- Hilbert 
algebras. 

Proof. Clearly ^(E) is turned into a Frechet space by transport of structure. It is densely contained 
in .^2(2) because G^pG is densely contained in 'H®'H . 

The basic complete tensor products in the case of Hilbert spaces arc described in [53l Sect. 48]. 
For instance, T-L^pT-L can be identified to Bi(?^) while T-L^i TL is canonically isomorphic to Moo{H) ; we 
recall that the Hilbert space tensor product T-L^T-L is isomorphic to 182 (H) . Taking into account the 
continuous embedding of G®pG into 'H®p T-L , the assertions ^(E) C ^1 (E) and then ^i (E)' C ^'(E) 
become obvious. But the dual of Bi(H) is M{H) , which permits the identification of ^i(E)' with 
^(E) C ^'(E) . 

Since ^(E) has been constructed by unitary transport of structure, it is enough to check that 
G®p ^ is a Hilbert algebra and a topological *-algebra. On G ® G the algebraic structure is uniquely 
defined by {u (E) v)* :— v ®u and (u^v)- {u' (® v') = {u' , v) [u ® v') € G ® G , valid for m, u, u', v' € G ■ 
Then one could conclude by density if it is checked that the involution and the multiplication are 
continuous with respect to the projective topology. For the involution this is very easy; we are going 
to treat the multiplication. 

Let {p\ I A G A} a directed family of seminorms defining the topology of G ■ Since G is densely 
contained in "H, there exists Aq € A and C > such that || u || < Cp\„{u) for all u e G ■ The projective 
topology on G ® G is defined by the family of seminorms {pa.^ | (A, /i) G A x A} given by 



PA.p(fD) :=inf <^^i 



Px{wi)Pf,{w'i) m = } wi (» w'l }; (2.35) 
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all the sums should be finite. For any A, /^ G A and any u, S 5® 5 one has 



P\,^{u-V) ^ ini <^px{wi)pf,{w'i) u-D = ^ 
I I I 



Wl ® Wi 



< mf <^ J2p>' (("j' "fc) %) Pt^i^k) II = XI "j" ® "i ' " "" XI 



j.k 



Ufc ® Wfc 



<inf Ell-;- 



j II II «fc II p^[ 



K'KK) u = E"i®"i. o = E^fc®^fc 



j\fc 



<C2inf <^ J2p^('^j)P^oiu'j)'^PXoMp,,ivk) u===J2^o'^^'r^ = J2^''®^'k 

= ^^ "^f \ E ^^ ("j )^^o ("j ) 11 = E "j ® "j f "^^ ) E P^" (^''^ ^^/^ (^'^ ) " " E 
[ i J J V fc k 



Vk(Sv^ 



= CV,Ao(u)pAo,A'('')' 

which justifies the continuity of the product. 

For further reference we indicate here the continuous embeddings 



D 



(2.36) 



The first and the last one become isomorphisms iff ^ = H . In most of the cases the operators 
7r(s) = n(es)* are unitary; in such cases e^ is not a compact symbol. 

Remark 2.15. The direct construction of the Frcchct-Hilbert algebra ^(E) by transport of structure 
is convenient being universal, but the output is rather implicit (although, clearly, {(f>u,v | m, w G 5} is 
a total family in ^(E) ; see [lU Th.45.1] for a stronger result). Fortunately, in most of the interesting 
examples, the space ^(E) has some independent definition as a space of functions (or distributions) 
onE. 

Remark 2.16. Wc stress once again that the space Q is not subject to any invariancc property 
However, if wc require tt{s)Q C G for every s e ^ , wc get immediately 6(s, i)^(E) C ^(E) for every 
(s, i) G E X E from ([23T|) and from the definition of ^(E) . 

Now wc need some notions concerning duality of Frechet spaces [53l Sect. 19]. When on the 
(topological) dual G' we consider the weak*-topology, we write G^- Recall that in this topology the 
convergence is just pointwise convergence of functionals and that a base of neighborhoods of G 5^ 
is composed of the polars of all the finite subsets of G- But we are also going to use the stronger 
topology 7 of uniform convergence on convex compact subsets of G, and then G' will be denoted by 
Giy ■ One can take as a base of G ^' the polars of the convex compact subsets of G ■ 

Using the transpose a' : H' — >■ G' (cf. [53l Sect. 23]) and the Riesz antilinear identification of TL 
with its strong dual H' , one gets an injective continuous antilinear embedding of H into the dual G' 
(or, equivalently, a linear embedding of H in G')- We identify thus H with a subspace of G', which 
is dense if on G' one considers any of the topologies a or 7. Hence wc have a Gelfand triple (GT) 
{G, H, Gl) for any v ~ a,j . Since the duality between G and G' is compatible with the scalar product 
of H , we are going to use for this duality notations as {u, w) :~ w{u) , antilinear in w £ G' and linear 
in u £ G ■ 
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Note that Q can be seen both as the dual of its wcak*-dual Q'^ and as the dual of Q' of [55] . 
In general it does not coincide with the dual of Cy^, involving the strong topology /3 of uniform 
convergence on the bounded subsets of Q. By a simple duality argument it follows that H (hence Q 
also) will be dense in Ql for i^ = ct, 7. This also happens for 1/ = /3 ii Q is assumed reflexive. If G 
happens to be a Banach space, we will speak about a Banach-Gelfand triple (BGT). In such a case, 
the strong topology /3 on Q' coincide with the norm topology given by || w llg;':^ sup{ | (u,!;;) | | m £ 

g,\Mg<i}. 

Of course, the same construction can be applied to the continuous and dense embedding 5(8)j, G ^-^ 

?^(8) v. , getting an ampler GT (^0^ G, V.® V., {G®p G)'^) ; one uses the transpose V,® H ^->- {G'Sip G)'v 
of the map a constructed in the proof of Lemma 12.131 Here, once again, one can use any of the 
topologies z^ = (T, 7, /3 . 

We recall now that we have an isomorphism of iJ*-algebras $ : %®T-L — ?> ^2(S) (in particular a 
unitary map) which restricts to an isomorphism of Frechet-Hilbert algebras $ : G®p G — ^ ^(S). The 
inverse of the transpose will be a continuous extension (denoted by abuse by the same letter) 

$:(g§pg)[^^^'(S]),; (2.37) 

the topological dual of ^(S) has been denoted by ^'(S) . 

We summarize the discussion above as a Corollary. By isomorphism 0/ Hilbert algebra Gelfand 
triples we denote an isomorphism of Gelfand triples (unitary at the level of Hilbert spaces) for 
which the "small" spaces are Frechet-Hilbert algebras, the Hilbert spaces are iJ*-algebras and the 
isomorphism respects the *-algebras structures whenever this makes sense. 

Corollary 2.17. Assum,e that the Frechet space G is continuously and densely embedded in % . There 
is a canonical isomorphism of Hilbert algebra Gelfand triples 

$" = $: {G®pG,n®n,iG®pG)l) ^(^(S),^2(S),^'(S).) . (2.38) 

Notice that for u,v G G' one has a well-defined element 0„^i, :— $(w (g) v) G ^'(E) . It is an easy 
task to state and prove suitable extensions of the relations (|2.13|) and (|2.14p . 

Remark 2.18. One has a canonical isomorphisms {G®pG) ^ ^{G,G'a)- It is purely algebraical 
and it involves the space of all the linear operators A : G ^ G' which are continuous when on G' 
we put the weak* -topology. See [531 pag.465] for more details. Using this, it is easy to deduce 
from the considerations above that H = A o <I>~^ : ^2(S) -^ B2(H) extends to a linear isomorphism 
H : ^'(E) — > M{G,G'a-)- Thus the elements of $#'(!]) can be seen as symbols of linear operators 
T : G ^f G' that are continuous with respect to the weak* -topology on the dual. The relation 



(H(r7)u, v)^ j dpi{t)g{t) {^{t)*u, v) = (g, 0,.„)(e) , (2-39) 

valid a priori for g £ =^2(S) and u,v E H, stands also true for g e ^'(E) and u,v E G with the 
obvious reinterpretation of the duality (•, •)(s)- 

Remark 2.19. Some extra structure is present if, in addition, G satisfies the approximation property. 
It would be too involved to discuss this property here; we just notice that the large majority of the 
Frechet spaces possesses it and send to [3S1 Sect. 18] for a thorough discussion. For us, it serves 
to identify the injective tensor product G'®iG with another topological tensor product G'eG and 
thus to simplify the picture. Anyhow, under this extra assumption, one has an extra canonical 
isomorphisms 

,G'.)-^{G®pG)\^G'^®^G',. (2.40) 
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The second one |36[ p. 346] is an isomorphism of locally convex spaces and it involves the topology 
of uniform convergence on compact convex sets on the various dual spaces. By general principles, it 
justifies the Hilbert algebra Gelfand triple {G®pG,'H®'H,G'-y'S^iQ.y) ■ 

2.4 Moyal algebras 

We work now on the extension of the algebraic structure. 

On the dual ^'(E) one can consider various locally convex topologies 71- which are stronger 
than the weak*-topology Ta but weaker than the strong topology Tp. Such a topology % is called 
admissible if it has as a basis of neighborhoods of the origin the polars of a family Si, of bounded 
subsets of ^(S) satisfying the following: 

1. ii A, B e S^ , there exists C E Si, such that AU B cC , 

2. if A £ S,y and a e M+ , then aA C B for some B e S„ , 

3. if A e S„ and / G ^(S) then f -k A e Si, , A* f e Si, a.nd A* e S,, . 

Let us write $^'(S)i/ for the dual ^'(E) when considered with the topology % ■ A net {i^AJAsA 
converges to in '^'{'E)^, iff F\{g) converges to uniformly in g G A for every A G S„ . Both the 
weak*-topology Ta and the strong topology 7/3 are admissible topologies; for this one takes 5o- the 
family of all finite subsets of ^(S) and Sp the family of all bounded subsets of ^(S) . Another example 
is the family S^ of all compact convex subsets of $^(S) , leading to the topology Ty of convergence 
which is uniform on compact sets. By [531 Th. 33.1], the bounded subsets of ^'(S)^ are same for 
all v (and are exactly the equicontinuous subsets). The strong dual ^'(I])/3 of any Frcchet space is 
complete. 

Theorem 2.20. 1. The composition law * extends to bilinear separately continuous mappings 

*:^'(S])^ x^(S])^^'(E)^ and * : ^(S) x ^'(E)^ ^ ^'(S)^ . (2.41) 

2. For / e ^'(S), g,he ^(S) one has 

f-k{g-*ch) = {fi.g)*h, h-k{g*f) = {h*g)-kf, (.g • /) • /i = .g • (/ • /i) . (2.42) 

3. The involution * extends to a topological anti-linear isomorphism * : ^'(I])j/ —S- ^'(E)^ , such 
that for every f e ^'(E) and g € ^(E) one has 

{f*9y = 9**r, i9*fr^r*9*- (2.43) 

Proof. 1. We justify only the first extension; the second one follows in the same way. 
For / e ^'(E) and g,he ^(E) one sets 

(/*5»(S) -(/./^*.9*)(s)- (2-44) 

Clearly this defines an element f * g oi ^'(E) , which coincides with the one given by the initial 
Hilbert algebra structure of ^(E) if / S ^(E) . 

We still have to show separate continuity. First fix g G ^(E) and pick a net {ffj.}fj.eM converging 
to in ^'(E)y . This means that for every B € Si, one has (/^, fc) — > uniformly in k E B . Fixing 
g € ^(E) and A € S„ , one has h E A ii and only ii h-k g* € A-k g* E S„ , hence 

(/m*5,^)(S) = (/a"^*.9*>(s) -5-0 uniformly in /i G A , (2.45) 
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thus /^ •s -^ in ^'(S)^.. Now fix / e ^'(E) and assume that g^ ^ in ^(S) . By Theorem 41.2 
in |53] , separate continuity of the map 7k- implies hypocontinuity. This means that for any bounded 
subset B of $^(S) the families of linear maps 

{^(S) eg^hi^ge ^(E) \heB} (2.46) 

and 

{^(S) eg^gi^he ^(S) \ h e B} (2.47) 

are equicontinuous. It follows that 

/i * 5* -^ uniformly in h e B . (2.48) 

Then 

(/ * 9^, /i)(s) ^{f,h* .g*)^j,j -^ uniformly inheB, (2.49) 

thus / • g^ ^ in ^'(E)^ and we are done. 

2. Recall that ^(E) is dense in ^'(E)^. . Than the associativity properties follow easily by 
approximation from the associativity of the composition law • in ^(E) . 



3. If / e ^(E)i, one sets {f*,h},^. := {f,h*),^s for any h G ^(E) . One gets a topological 
isomorphism for any v because the family Si, was supposed stable under involution. For / £ ^'(E) 
and g,h £ ^(E) we compute using the definition of the involution and the axioms of a Hilbert algebra 



= (r,(/i'^*.9T)(E) = (r,.9*/^)(s) = (.9'^*r,M(E) > 

so the first equality in (iii) is proven. The second follows similarly. D 

Definition 2.21. We introduce the following subspace 

?C(E) := {/ e ^'(E) |/^^(E)C^(E), ^(E)*/C$^(E)} 

and call it the Moyal algebra associated to • . 

Obviously ^^(E) is invariant under the involution / h- > /*. Wc extend the composition 

*:^:(E)x^i(E)^$^:(E) (2.50) 

by setting 

{f*g,h)^^y.^{f,g*h)^^^, V/, g G ^^(E), /i G ^(E) . (2.51) 

To justify this extension, notice first that if <? G ^^(E), then the mapping 

^(E) 9/1^^ Lg(/i) =5*/iG^(E) (2.52) 

is well defined, linear and continuous. Actually it is continuous when regarded with values in ^'(E)i, , 
by Proposition I2.20[ and then we use the Closed Graph Theorem to get the improved continuity. It 
follows (even for / G ^'(E)) that the formula ()2.51|) defines an element f-kg of ^'(E). To prove that 
in fact it belongs to the Moyal algebra, one must show that 

(/*.g)*fc G^(E) and A:*(/*5) G^(E) for any fc G ^(E) . (2.53) 

For the first one, for instance, one infers by approximation from the previously results that (/*(7)*fc — 
f -k {g-kk) and then apply the definition of ^iij^) ■ 

Without making all the routine verification, we just state that (^^(E),*,* ) is a * -algebra in which 
^(E) is a self-adjoint two-sided ideal. More details about Moyal algebras associated to abstract 
composition laws, their topologies and their connections with algebraic representations in locally 
convex spaces will be given in a subsequent publication. 

15 



3 Some examples 

It is quite clear that the formalism of the previous section is ment to cover at least two situations: 
square integrable irreducible unitary group representations with their associated twisted convolution 
algebras [U [2j [S] [13] and the Weyl pseudodifferential calculus [20l [24l [31] . We are going to indicate 
briefly other examples, in order to show the generality of our setting. They are developped just to 
the extent when the identification of the relevant objects becomes obvious, but we hope to give more 
details and applications in some future publication. The references cited in this section contain much 
more than we are able to review here. 

3.1 The magnetic Weyl calculus 

One takes E := A" x X* , where A" is a n-dimensional real vector space and X* is its dual (so the 
"phase-space" E is non-canonically isomorphic to R^"). Bellow, setting B = and A = , one would 
recover the standard Weyl calculus [20", "241 [31] . 

The magnetic Weyl calculus [35j.37j.38i [SSI [lU [42] has as a background the problem of quantization 
of a physical system consisting in a spin-less particle moving in the euclidean space X = M" under 
the influence of a magnetic field, i.e. a closed 2-form B on X {dB = 0) , given in a base by matrix- 
component functions 

Bjk = -Bkj : X ^m, j, fc = 1, . . . , n . 

For simplicity and in order to have a full formalism we are going to assume that the components Bjk 
belong to C^^{X), the class of smooth functions on X with polynomial bounds on all the derivatives. 
The magnetic field can be written in many ways as the differential B = dA of some 1-form A on X 
called vector potential. One has B ~ dA = dA' iS A' ^ A + dip for some 0-form ip (then they ar 
called equivalent). It is easy to see that vector potential can also be chosen of class C^^{X) . 

One would like to develop a symbolic calculus taking the magnetic field into account. Basic 
requirements arc: (i) it should reduce to the standard Weyl calculus for ^ = and (ii) the operators 
n"^(/) and n^ (/) should be unitarily equivalent (independently on the symbol /) if A and A' are 
equivalent; this is called gauge covariance and has a fundamental physical meaning. There are many 
ways to justify the formulae, including geometrical or classical mechanics reasons or ideas coming 
from group cohomology and the theory of crossed product C*-algebras. The one closest to our 
approach it to think of the emerging symbolic calculus as a functional calculus for the family of 
non-commuting self-adjoint operators (Qi, . . . , Q„; Pj^, . . . , P^) in V. := ^^(X). Here Qj is one of 
the components of the position operator, but the momentum Pj :— —idj is replaced by the magnetic 
momentum P- := Pj ~ Aj{Q) where Aj{Q) indicates the operator of multiplication with the function 
Aj £ C^i(A') . Notice the commutation relations 

i[Q3,Qk]^0, i[Pf,Qk]^S,.k, i[Pf,P^] = B,kiQ). (3.1) 

Now one computes the m,agnetic Weyl system, 

7r^:S^BCH), 7r^(x,0 := exp [i (x • P^ - Q • $)] (3.2) 



and gets explicitly 



[7r^(x,0«](2/)=e-<'y+t)-« 



exp 



(-„ j A 



u{y + x). (3.3) 



The extra phase factor involves the circulation of the 1-form A through the segment {x,y\ := {(1 — 
t)x + ty I t G [0, 1]} . These operators depend strongly continuous of (a;, £) and satisfy 7r"*(0, 0) = 1 
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and TT (x, ^)* = tt{x, ^) ^ ~ tt (— x, — ^) (thus being unitary). However they do not form a projective 
representation of T, — X x X* . Actually they satisfy 



T:^{x,0^^{y.ri)^^''[{x,0.{y,v):Q]^^{^ + y,^ + v), 



(3.4) 



where Vl^ [(x, ^), (y, 77); Q] only depends on the 2-forni B and denotes the operator of multiplication 
in ^'^{X) by the function 



X3 z^n^[{x,C)Av.^)-.A :=exp 



{y-£.-x-i]) 



cxp 



<z.z-\-x,z-\'X-\-y> . 



(3.5) 



Here the distinguished factor is constructed with the flux (invariant integration) of the magnetic 
field through the triangle defined by the corners z, z + x and z + x + y . 
A straightforward computation leads to 

[$^(m ® v)] {x, ^) := (7r^(x, ^)u, v) 



dye' 



-iy< 



exp 



X 



A 



[y-x/2,y+x/2] 



u{y + x/2)v{y-x/2). 



It can be decomposed into the product of the multiplication by a function with values in the unit circle, 
a change of variables with unit jacobian and a partial Fourier transform. All these are isomorphisms 
between the corresponding spaces, so the orthogonality relation holds with ^2(2) — ^^(S) . 

Thus one can apply all the prescriptions and get the correspondence / 1— >■ 11 (/) and the compo- 
sition law (/, 5) — !" /*^ 3 (depending only on the magnetic field). In fact people are interested in the 
(symplectic) Fourier transformed version a {Q,P^) = Op (a) :— Il"^[S^^{f)] and in the multiplica- 
tion #^ obtained by transport of structure and therefore satisfying Dp (a)Dp (b) ~ Op [a^f^^b) . 
The resulting involution is just complex conjugation, thus Dp (a)* = Dp (a) . For the conve- 
nience of the reader we indicate the explicit formulae, in which we set F ([a;,y]) :~ j, , A and 



F^(< x, 2/, z >):=/. 



<x,y,z> 



B . The magnetic Moyal product is 



(a#^6) (X) = ^-2" f dY f dZ exp {-2t [{x - z) ■ {^ ~ tj) ^ {x ~ y) ■ {^ - ()]} x (3.6) 

X exp [— iF {< X — y + z,y — z + x,z — X + y >)] f{Y)g{Z) 
and the magnetic Weyl calculus is given by 



Dp^(a)w 



(x) - (27r)-" ^ J^^ dydi exp [i{x ^ y) ■ £] exp [-iT\[x, y])] a {^^.i\ u{y) . (3.7) 

An important property of p.7p is gauge covariance, as hinted above: if A' = A + dp defines the same 
magnetic field as A, then Dp (/) = e'^f Dp (/) e^*'' . By killing the magnetic phase factors in all 
the formulae above one gets the defining relations of the usual Weyl calculus. 

A convenient choice of auxiliary space in this case is the Schwartz space Q = S{X) which is a 
nuclear Frechet space continuously and densely embedded in ^^(S) ; thus Q' will be the space of 
tempered distributions. By a simple examination of the map ^^ , this leads to ^(E) = S{X x X*) . 
It can easily be shown that (by suitable restriction or extensions) Dp [S{X x X*)] = M[S'{X), S{X)] 
and Op^[S'{X x X*)] = B[S{X),S' {X)] . The Moyal algebras for the magnetic Weyl calculus are 
studied in detail in [38], while in [35] the full pseudodifFerential theory is exposed. Non-symmetric 
r-quantizations are also available and they also fit the setting of Section [2j 
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3.2 Pseudodifferential operators on Abelian locally compact groups 

We mention now the situation treated in [3D] , see also [111 [53] , in which the peudodifferential calculus 
(in its standard form due to Kohn and Nirenberg) is generalized to metrizable, second countable 
locally compact Abelian groups (LCAG in short), using a "Harmonic Analysis approach" instead of 
the hard analysis treatment which would not be available in such a generality. 

The starting point is a LCAG denoted by G, serving of "configuration space"; important simple 
examples are G ~ M.'^ or G — Z"^ but p-adic groups Qp are also within reach and interesting for 
quantization and pseudodifferential theory [32] (45] [55]. A general version of a "phase space" (or 
Time- Frequency plane) is S := G x G, where G is the Pontriagin dual of G. On S , which is again a 
LCAG, we consider a Haar measure /x. It is obvious that by the Pontriagin duality theorem the dual 
S can be identified to E . One uses notations as s = (x, ^), i = (y, vj) for elements of S, with x,y E G 
and £,,r] G G . The group duality is denoted by < •, • > . 

We define the Hilbert space H := ^^(G), with unitary group V{H) and the mapping 

7r:S^U(H), [n{x,^)u]{z) :=<£_, z> u{z-x). (3.8) 

A simple calculation shows that tt is a (continuous unitary) projective representation with 2-cocycle 

KiExS^T, K{{x,OAy:V))-^ <rj,x>. (3.9) 

The orthogonality conditions also hold, so we are in the required setting. But a lot of extra structure 
is present due to the existence of a Fourier transform and to the structure theorem for LCAG. In 
particular, besides choosing for the ingredient Q the Bruhat-Schwartz space, there also exists a better 
choice relying on writting G as R™ x Go with Go containing an open compact subgroup. We do not 
review the theory, for which we refer to [30] which also contains a lot of constructions and results 
involving a certain class of coorbit spaces, discretization techniques and Gabor frames. If G = M™ (i.e. 
Go is trivial) the emerging formalism boils down essentially to the Kohn- Nirenberg pseudodifferential 
calculus [20] . 

3.3 Unitary representations of infinite dimensional Lie groups 

Rclevent references are [331 [H [S] [S] [Z] j to wich we send for a full presentation. 

The starting point is an unitary strongly continuous representation tn : Af — > U('H), where M is 
a locally convex (maybe infinite dimensional) Lie group with Lie algebra m and smooth exponential 
exp^,^ : m — )► M. On the dual m' of m we consider the weak topology. 

We also fix a real finite dimensional vector space S with dual E' and a linear map : E — > m. The 
basic idea is to use tt := tnoexp^^^o 6* : E — )► M{'H) as well as the Fourier transform ^: .if^(E) — > ^^(E') 
in order to build a very general form of the Weyl calculus. So, at least formally, one should set 

Dp^'^a) = n (a) := / dsa{s) w [expA^(6'(s))] . (3.10) 

The outcome was called in [7] the localized Weyl calculus associated to w localized along 6. The single 
requirement needed to develop the basic part of the theory is orthogonality, i.e. 

ds\{m[eyi-pM{e{s))]u,v)\^ ^\\uf\\vf, yu,ven. (3.11) 

s 

Under this requirement, the general theory gives a definite sense to p.lOp at least for a G ^2(S) and 
the constructions and results of sections 12. Il and l2. 21 are valid. A good choice for the auxiliary space 
Q is the space of smooth vectors of the representation zu : 

g = noc:^{uen\M3 m ^ Tu{m)u £ TLis C°°} . (3.12) 
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It carries a natural Frechet topology [71 Remark 2.1] in terms of "differential operators" indexed by 
the universal associative enveloping algebra C/(mc) of the complexified Lie algebra mg;. In the infinite 
dimensional case the denseness of "Hoc in T~L is not always verified so we must require it explicitly. 
But as soon as this is achieved, all the results of the present article hold. In [7] extra regularity 
assumptions are imposed in order to have good control upon the spaces involved. One of the aims 
is to identify ^(E) with the Schwartz space ^(S) and Op"^'" ^^) ^ H [^(E)] with the Frechet 
space B(H)oo of all the smooth vectors (operators) under the continuous unitary representation 



w"- 



(2) : Af X il/^BpaCH)], \w^'^\m,n)\T -.^ w{m)Tw{n)-^ . (3.13) 



Another one is to determine when .^2(S) = ^"^{Yj) happens. 

The very particular case in which M is a finite dimensional connected and simply connected 
nilpotent Lie group leads to what has been named the Weyl-Pedersen calculus j43| . which is still 
highly non-trivial and for which the regularity assumptions are shown to hold. But controllable, 
more general situations are considered in [4j [6l [7], in which M can be written as the semidirect 
product J- K G between a (finite diinensional) connected nilpotent Lie group G, with Lie algebra 
0, and a suitable (typically infinite dimensional) locally convex space J-" of smooth functions on 
G. An important particular case comes from the presence of a smooth magnetic field on G. The 
appearance of the finite dimensional vector space S is connected to the coadjoint orbit associated to 
the representation w and the linear mapping 9 is assigned canonically to a vector potential generating 
the magnetic field. Actually, S = g x g' is one of the possible realizations of the coadjoint orbit. The 
outcome is an extension to nilpotent Lie groups of the magnetic Weyl calculus shortly exposed in 
section l373l which can be reobtained by taking G — M". 



4 The coorbit formalism 

We are going now to introduce coorbit spaces of vectors (included in Q') and coorbit spaces of symbols 
(included in ^'(S)). For the first, in accord with the existing theory [171 EI], it is clear that we must 
use an inducing procedure by 4>w '■ G' ^ ^'(S) , where (pwiu) := (l)u,w = ^{u eg) v) and the fixed 
"window" w could be taken in Q for convenience. So, for a Banaeh space A^ continuously embedded 
in ^'(E) , one gets a Banaeh space cOui{M) := (f>~-^{M) continuously embedded in G'. This goes 
along the lines of [17] and the setting is more particular than that of [211 El] j so there is nothing to 
claim and in this article we are very brief about the spaces cOtu(A^) . 

For symbols, one must first construct the analogous mappings T/,, : ^'(E) ^ ^'(E x E) indexed 
by "symbol windows" h , profitably chosen in ^(E) ; we denoted by ^'(E x E) the topolgical dual of 
^(E)(g)p ?^(E) . But actually, analogous to $ , there is a naturally defined isomorphism (the canonical 
mapping) T : {#'(E x E) — > ^'(E x E) generating the family {Tji \ h £ ^(E}) by localization, using 
the tensor product structure: one sets Th{f) :— T(/ h) for all / G ^'(E x E) and this also makes 
sense for h G ^'(E) . (See [40] for a related construction in a more restricted framework.) 

In fact, as shown in Corollary 14. 7[ T can be seen as a Hilbert algebra Gelfand triple isomor- 
phism and this continues smoothly the theory of section [273] We arrange things so that the algebraic 
structure on the second Hilbert algebra Gelfand triple be independent on our data tt; it just involves 
composition of integral kernels. For suitable windows h , this facilitates studying the algebraic prop- 
erties of various coorbit spaces obtained by inducing through T^ . We think that preservation of the 
algebraic properties is one of the main merits of the present coorbit construction. 

Once the basic properties of the canonical mapping T are obtained, a reconstruction formula is 
available and the typical ritual of a coorbit theory is released. The procedure generates Banaeh spaces 
COh {^) of " functions" on E from Banaeh spaces ./# of " kernels" on E x S . Under some admissibility 
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conditions one gets standard information about dcnscness, duality, interpolation, independence of the 
window. 

The two types of coorbit spaces are related because the two mappings <& and T are intimately 
connected, as indicated in Propositions 14.51 and 14.221 The main consequence is Corollary 14.231 for 
Banach spaces ^/£ C $^'(E x S) and M.\,M.i C ^'(S) (and for suitably tuned windows), the symbols 
/ e CO(^) give raise to bounded operators n(/) : cOtu(A^i) -^ co^(A^2) if the kernels F & ^ give 
raise to bounded integral operators 3ni{F) : A4i ^ A^2 ■ This second assertion is universal, it has 
nothing to do with the data tt and the symbolic calculus 11 and can be checked independently. Thus 
one gets efficient boundedness criteria for "the pseudodifferential operators" n(/) in terms of coorbit 
spaces of vectors and symbols. 

We end the chapter with a construction concerning " reservoirs" . In most of the applications there 
are natural notions of test vectors or functions and the dual objects, forming spaces of distributions, 
are large enough to contain the Banach spaces one might want to study. This is essentially due to 
the fact that the Hilbert space % is very often a space .if^(A') of functions on some "configuration 
space" X. But it is a matter of fact that, under some mild assumptions, a rather general construction 
of window spaces of vectors Q is available; then the formalism will supply automatically the other 
relevant spaces as ^(S) or ^'(E x E) . We follow the treatment in [21], building on the approach of 

m- 

4.1 The canonical mapping on symbols 

Definition 4.1. W^e set T : ^2(E)§^2(E) ^ ^^(j] ^ E) = ^2(j^)g_^2(5.) ^y 

[T{f®h)]{s,t):={f^et*h,es)^j:)^{f*et*h){s). (4.1) 

and call it the canonical map. It depends on -k , so implicitly on n . 

Remark 4.2. The second equality in (|4.ip . valid /i-almost everywhere, follows from ProDOsition l2.4l 
since f * et * h e ^2(E) • ^(E) * ^2(E) = ^i(E). Using Remark [2TT0l and the cyclicity relation 
(|2.18p . one can also write 

[T(/®/i)](s,i):=(e(s,i)/,/i*)(s) • (4.2) 

The full justification of Definition 14. II will be given in Theorem 14.41 
Remark 4.3. It is easy to check that (|4.ip is equivalent to the weak definition 

(T(/®/i),5®fc)(5.^5.) :={f^k^h,g)^^^ = {f^k,g^h*)^^^, V/,5, /i, fc £ ^2(E) . (4.3) 

This offers a good starting point for extensions to larger spaces. It is the point of view adopted in 
[40] for the particular case of composition laws a priori defined on the Schwartz space ^(R^") . 

A very useful fact is that ^^(E x E) is an H*-algebra, in a way that does not depend on our 
starting point, the map tt : E — > M{H) . Besides the canonical scalar product, one also has the 
composition of kernels 

(F • G){s, t) := / dn{r)F{s, r)G{r, t) (4.4) 

and the involution 

F*(s,i):=F(M). (4.5) 

On the other hand, on the Hilbert tensor product ^2(E)Cx) ^2(E) we can consider the law -^ := •(g)* 
uniquely defined by 

(/i®/2)*(,gi(8 52) :=(/i*5i)®(52*/2) (4.6) 

and the tensor product involution (/i (g) /2)* '■— fi®f2- 
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Theorem 4.4. The canonical mapping T : (^2(S)(§ ^2(2) , * ,* ) -> (^^(S x E) , • ,* ) is a iweH- 
defined isometric morphism of H* -algebras with range ■!^2(^)® ^2i^) ■ 

Proof. Using (|2.30p and the fact that $ is isometric, for any iti,U2,wi,W2 G H and any s,i £ S one 
has 

Thus T {(j)u-^^vi ®4'u2,v2) = 4'u-i,v2 ® 4'vi,u2 which, together with the orthogonahty relations verified 
by the functions (^«,„, imphes easily the isometry property and the identification of the range. 

Let us check the algebraic properties. For f,g,h,k G i^2(S) one has 

T[(/ <E> h)M9 ® ms,t) = T [(/*(?) (h^k)] {s,t) 

= ((/*ff)*et,e^*(fc*/i)*)(2)- 

On the other hand, using cyclicity and relation p.2ip 

[T(/ <E> h) . T{g k)] {s,t) = / dfi{r) [T(/ h)]{s,r) [T{g ® k)]{r,t) 

= / dfi{r)(f-ker,es*h*}(^^^{g-*:et,er*k*)^^^^ 

= / c?At(r)(er,/**es*ft.*)(5.) (g^et^fc, er)(s) 
= {g-ket*k,f*-kes-kh*)^^^ = {f -k g-k et,es-kh*-kk*)^^-^ . 
The fact that T intertwines the two involutions also follows from the properties of a Hilbcrt algebra: 



D 

In order to establish the connection between the mappings $ and T, let us consider the represen- 
tation of {^^{Ti X S) , • ,* ) on the Hilbcrt space ^^(E) by integral operators 

[3ni{F)h]{s) := [ dn{t)F{s,t)h{t); (4.7) 

the range of the representation is composed of all the Hilbert-Schmidt operators on ^^(E). By 
composing with T, one gets a representation 

antoT: (i^2(S)®^2(S),*,*) ^M[^^{^)] . (4.8) 

Since 3nt{f i^g) = {■,'g)(^)fi ^^ see easily that 3nt{F) leaves the closed subspace ^2(2) invariant for 
any element F of ^2 (S)(X> ^2 (S) ; then working with restrictions one clearly has ^Jnt [^2 (S)(g) ^2 (5^)] = 
B2[i^2(S)] . With this interpretation we are going to show that 3nto T is unitarily equivalent with 
the tensor product of the representation 11 (in the Hilbcrt space H) with its opposite H (defined by 
H(/) := H(/)*). via the unitary operator $ : H(E)'H — > ^2(2) . For the notation {L, R} we refer to 
(I2T2I) . 
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Proposition 4.5. One has 

3ntoT = U$o(n(8n) = {L, R}, (4.9) 

where U<i.(S) := $ o S o $-1 for S £ M{n^n) . 

Proof. Let f,g, k £ ^2(S) and s G S . A computation using Remark 12.81 and the fact that below all 
the products of three elements is a trace-class symbol gives 

{[(3nt o T)(/ ® g)] k} (s) = [ dii{t) [T(/ ® g)] (5, t) k{t) 



= / diJ.{t){et,f*-kes*g*)(^)k{t) 



d^i{t)k{t)et, f* i^ Csi^ g* 

S / (S) 

= (/*fc*g,es)(s) == {.f*k-kg){s). 
On the other hand, computing on k = <f)u.v (such that $^^(/i) = u (g) w) and using (|2.15p : 

{ [u* o (n ® n)] (/ ® 5)} 0«,. - * {[n(/) ® n(.g)*] (.. ® t;)} 

= 0n(/)«,n(g)'i) = / * (t>u,v * g 
= [{L,R}(/0g)] ,/>„,,, 

and we conclude by totality. D 

Remark 4.6. From now on we are going to use the abbcreviations 

^(E xE) :=^(I])®p^(E), /^2(S X E) := ^2(2)® i^2(S) , ^'(E x E) :=: ^(E x E)'. (4.10) 

They are just convenient notations, but in many examples they have a very natural meaning. If 
Q satisfies the approximation property, so does the Frechet space G^p Q by [36] and also ^(E) by 
transport of structure. Therefore in such a case, by Remark [2.19[ one has the topological isomorphism 

^'(E x E)-, 9i ^'(E)-,§i^'(E)^ . 

Let us place ourselves in the framework of Section 12.31 Recall that the family {(j)ui,vi ® 4'u2,v2 I 
ui,vi,U2,V2 G G} is a total subset of ^(E x E) . Since we have T {(j)ui,vi ®4>U2,V2) = 4>ui,v2 ® 4'vi,u2 
(see the proof of Theorem 14. 4p . it follows that T [^(E x E)] = ^(E x E) , so we get by restriction an 
isomorphism of Frechet-Hilbert algebras 

($^(E X E) , * ,* ) ^ (^(E X E) , . ,• ) . (4.11) 

Continuity follows from the Closed Graph Theorem or directly from a careful examination of the 
projective topologies. Therefore, by arguments similar to those in Section [^^ and relying on Theorem 
14.41 one gets 

Corollary 4.7. Assume that the Frechet space G is continuously and densely embedded in % . Then 
there is a canonical isomorphism of Hilbert algebra Gelfand triples 

T : (^(E X E),i^2(S X E),^'(E x E)^) ^ (^(E x E),^2(S x E),^'(E x E)^) . (4.12) 
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The two Gclfand triples above are identical within the category of locally convex spaces but are 
very different as *-algebras; see (|4.1ip for instance. As before, on ^'(S x S) any of the topologies 
u ~ a,^, /3 is allowed (simultaneously in both members, of course). 

The procedure of extension of the algebraic structure indicated in section [2^ can be applied to the 
Frcchct-Hilbert algebra (^(S x S), *,*), gettingaMoyal algebra ^^(Sxl]), and to (^(S x S),*,'), 
getting a Moyal algebra ^,'(S x E) . One gets easily 

Corollary 4.8. The application T restricts (or extends, depending on the starting point) to an 
isomorphism of * -algebras 

T :^4(I] xE) ^^.'(S xE). (4.13) 

Remark 4.9. Later on we are going to need the fact that the unitary integral operator 3nt : 
^2(S)§^2(S) -^ B2[^2(S)] extends to a linear isomorphism ant : ^'(S x S) ^ B[^(S),^'(S)^] . 
This is actually the isomorphisms of Remark 12.181 with Q replaced by the Frechet space ^(S) (and 
H replaced by the Hilbert space ^2(S)) . We set 3ni{f ^ g)h = {h,g),^^f for every /,g £ $^'(S) and 
h G ^(S) and this mapping defined on the algebraic tensor product ^'(S) ®'^'{Y,) , compatible with 
the initial O^nt , extends to the final isomorphism. 

We now perform localization of the canonical mapping on symbols; it amounts essentially to 
regarding T as a " function of two variables" and then fixing the first one in a convenient way. For 
h £ ^2(S) \ {0} (often called window or analyzing vector) we set 

T;,:^2(S)^^2(SxE), Thif):=T{f®h). (4.14) 

Defining 

A:^2(S)->^2(S)g^2(S) by Jh{f) ■= f ® h , (4.15) 

then in terms of the adjoint J^ : ^2(^)0 ^2 (S) -^ ^2(S) given explicitly by 

jl{F)\{s)^{F{s,-),h)^^^, /i-a.e. seE, (4.16) 

one has the relations 

J,"[ o Jfc = (fc, /i)(5.)id, Jfe o J,'[ ^ id ® ant(fe (g) 7i) . (4.17) 

Then clearly T/j = T o J;, and the following formulae hold: 

Tt o Tfc = Jl o Jk = (fc, h)^^^ id , (4.18) 

Tfc o t|^ = T o [id ® 3ni{k ® h)] o T-^ (4.19) 

In particular || h ||j^, T^, is an isometry with range T [.^2(S) ® Ch] . If h and k are not orthogonal, 
we get from (|4.18p for any / G ^2(2) 

/-77-^TfI[Tr^(/)]> (4-20) 

which is referred to as the inversion (or the reconstruction) formula. 

Although the relations above will be sufficient subsequently, we are also interested in an explicit 
formula for the adjoint Tj^ . An easy computation leads to 

TI{F)= I I dfi{s)dfi{t)F{s,t) es*h*-ke*, Vi^ £ ^2(2 x S) , (4.21) 

which should be interpreted weakly, i.e. applied by duality on vectors / S ^2(S) . 
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Remark 4.10. Let us discuss algebraic properties. By using Theorem 14. 4[ one gets immediately for 
every/,5,/i,/ce^2(S) 

T/.(/).T,(g) = Tfe.,(/*5), T;,(/)- = T,.(r). (4.22) 

Hence, very often, we are going to use self-adjoint idempotent windows h ~ h* = hi^ h , for which 
the localized canonical map Th will be a monomorphism of * -algebras. To give a useful example, one 
gets a self-adjoint projection h = (f)w,w for any unit vector w . 

All the above form the ^^-part of the localized theory of the canonical map. Let us use now 
the opportunities offered by the Gelfand triples constructed in sections 12.31 and 14.11 starting from a 
Frechet space Q continuously embedded in % . 

In fact most of the time we fix a window h in $#(!]) \ {0} and, besides the initial T/, = T o J,j , 
we work both with the restriction T^ : $#(!]) — > $#(S x S) and (especially) with the extension 
T/j : ^'(E),^ — > ^'(E X E)j^ . They are all well-defined linear injective and continuous because of the 
isomorphism properties of T specified in Corollary 14. 71 and the obvious mapping properties of 

Jh : ^'(E) ^ ^'(E) ® ^(E) C ^'(E) ® ^'(E) C ^'(E x E) . 

It would be cumbersome to give them different names, so the meaning should be specified when 
needed or deduced from the context. 

On the other hand, T,^ : ^(E) -^ ^(E x E) possesses an adjoint TJ^ : ^'(E x E)^ -^ ^'(E)i. which 
is linear and continuous for any of the topologies v = cr, 7,/3 (cf. [531 p. 199]) and which extends 
the previous TJ^ : ^2(S x E) ^ .^2(S) . The inversion formula (J^ still holds for f e ^'(E) 
and h, k G ^(E) with (h, k),■^^ ^^ , by the continuity of the ingredients of the expression Tj^ o Tfe : 
^'(E),, -> ^'(E)i. and the fact that .^2(S) is dense in ^'(E)^ ior v = a,j . One gets the same 
conclusion for v = /3 hy analyzing in detail the way these ingredients were defined, but this is not 
necessary. 

Remark 4.11. The treatment of extension of the maps T and T^, is rather abstract. It relies 
on tensor products and duality techniques working in the general setting of what we called above 
Hilbert algebra Gelfand triples. We indicate now briefly another approach on extending T^ , based 
on Remark HSl Formula dS]) suggests deflning T/,. : ^'(E) -> ^'(E x E) by 

{T^,(f),g®k)^^^^y.= {f,g^h**k*)^^.^^{f^k,g*h*)^^^, (4.23) 

where h £ ^(E) \ {0} is the fixed window and g, k are arbitrary elements of ^(E) . The third term in 
(I4.23|) . if needed, relies on the extension given by Theorem 12. 201 One can also write the quantities in 
(|4.23p as (3nt [T;i(/)] g, k),^-, . Rather straightforward arguments justifies this definition and extracts 
from it the useful properties of T^ ; the reader will easily check the compatibility between the two 
points of view. 

4.2 Coorbit spaces of symbols 

We keep the same setting as above, consisting of the data (E,//, 5,H,7r) , assuming Hvpohesis 12.11 
and the fact that 5 is a Frechet space embedded densely and continuously in the Hilbert space Ti . 

Definition 4.12. Let ^ be a vector subspace of $^'(E x E) . Its coorbit space associated to the 
window h g ^(E) \ {0}) is 

QOh{.M) := {/ e $#'(E) I T„(/) e ^} . (4.24) 
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Clearly CO/, [^'(S x E)] == ^'(S) , and for such a result one could also take h e ^'(E) . Anal- 
ogously, one has CO^, [i^2(S x S)] = ^2(S) even for /i G ^2(S) \ {0} . However, we are going to 
confine our interest to "smooth" windows h G ^(S) . Notice that the spaces ^(S) and ^'(S) , being 
isomorphic to some topological tensor products, arc somehow particular. The generality of the space 
Q as well as lot of examples validate our decision to choose windows in ^(S) and the space ^'(S) as 
a " reservoir" , but this is not the single option. 

The next result gives a first nontrivial example of coorbit space and will also be useful in some of 
the subsequent proofs. 

Lemma 4.13. Let h G ^(I])\{0}. Then f e ^'(E) belongs to ^ {i:) if and only if Th{f) e^(SxI]). 
In other words CO,, [^(S x S)] = ^(S) . 

Proof. The "only if part" is already known. For the "if part", assume that T/,(/) G ^(E x S) . By 
the extended inversion formula and by the obvious mapping property Tj^ : ^(S x S) — >■ ^(S) one 
has 

f = \\h\\-^^Ti[T^if)]e^i^). 

n 

Even before introducing topologies, let us give some algebraic properties of the coorbit spaces. 
The extensions of the algebraic structures (Theorem 12. 20p and of the isomorphism T (Corollarv l4.7p 
allow us to state useful versions of ()4.22|) . For example, this relation also hold for g,h,k (^ ^(S) a-nd 
/ G ^'(E) . The next Corollary follows easily from the definitions, from such considerations and from 
Lemma [4.131 see also Corollary [ 



Corollary 4.14. 1. If hi^h^h* ^h€ ^(E) \ {0} , then T^ : ^'(S) ^ ^'(S x E) restricts to 
an infective morphism of * -algebras T,, : ^^(E) — > ^,'(E x E) and one has CO/, [^j(E x E)] = 

2. If y^ is a * -subalgebra of ^,'(E x E) , then CO/i(./#) is a * -subalgebra of ^^(E) . 

If (^, II • 11^) is a normed space (usually taken to be continuously embedded in ^'(S x E) 
endowed with the weak*-topology), we endow QOh{^) with the norm 

ll/llco.(^):=l|T,,(/)|U. (4.25) 

More general locally convex topologies could be pulled back through the localized canonical map, but 
we are not going to do this. 

Proposition 4.15. Let ^ be a normed space continuously embedded in ^'(E x E)(j . 

1. For h G ^(E) \ {0} , CO/i(./#) is a normed space continuously embedded in ^'(E)^ . 

2. If ^ is a Banach space, C0/,(^) is also a Banach space. 

Proof. 1. It is obvious that || • ||cOfe(.^) is a norm; recall that T^, : ^'(E) -^ ^'(E x E) is injective. 

If /„ converges to / in COh(^) , then Th{fn) converges to T;,(/) in ^, hence also *-weakly in 
^'(E x E) . But T : ^'(E X E)^^ -^ ^'(E x E)^^ is a topological isomorphism and thus /„ ® h converges 
to f (g) h *-wcakly in ^'(E x E) . It follows that /„ converges to / *-weakly in ^'(E) . 

2. Let us show that the inducing process preserves completeness. Clearly CO/i(./#) is isometrically 
isomorphic to ^{h) := M n Th[^'(E)] . So we have to show that ^(\i) is closed in ^ . Let 
{^hifn)) pRT be a sequence in ^{h), converging to G G ^ . Due to the continuity of the embedding 
of .^ in ^'(E X E) we also have 

'^hifn) -^ G in^'(ExE). (4.26) 

n—^oo 
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Set / := Trj^Tj^{G) £ ^'(S) . Using the extended inversion formula one gets 



II h \\fj.j "^oo 



which, together with g^H), imply G = T;,(/) e ^{h) . D 

Plainly, in Proposition 14. 151 the weak* topology can be replaced by others, as :/ = 7 or t^ = /3 for 
instance. When the choice of the topology on ^'(S x S) is not important, we are no longer going to 
indicate it explicitly. 

Remark 4.16. Obviously, if || • ||^/ is a C*-norm then |[ ■ ||cOh(^) '^ill ^1^° ^'^ ^ C*-norm: 

II r * f llco.(V/) = II T,(r ^ /) 11.^ = II T„(/)' . Tn{f) lU = II T„(/) W'',^ = \\ f |||o.(^) ■ 
We study now the dependence of the induced norms and spaces on the window h . 
Proposition 4.17. Assume that for some h, k G ^(S) \ { 0} one has 

(Tfc o T|J Ji dJ^. (4.27) 

Then COh{^) C COfc(^) . In addition, if ^ is a Banach space continuously embedded in ^'(SxE) , 
the embedding of CO h{^) in COfe(./#) is continuous. 

Proof. By the extended inversion formula, if / G CO^ (^) then 



II "- ll(S) 



which implies COh{^) C T\{^) . So we need to show that TJj(.^) C COfe(^) . But 

/ = Tt(G), withGG^ =^ Tfc(/) = [TfcoT|j(G)G.^. 

To prove the topological embedding, note that T^ oTJ^ G B(.-#) by the Closed Graph Theorem. This 
and the inversion formula give easily the norm estimate 



/l|co.(^)-^^||Tfe[(TtoT,)/ 
, II T^fc ° Tjj IIb(^) 

- — inni2 ii/iicoh(^ 

ll"ll(S) 



n 



Let us say that the subspace ^ is admissible if one has (T^ o TJ^) ^ C ^ for every h,k E 
^(S) \ { 0} . By the result above, if a Banach space j£ continuously embedded in ^'(S x S) is 
admissible, we could speak of the Banachizahle space CO(^) := T^ (^) , which is continuously 
embedded in ^'(S) ; the vector space and the topology do not depend on /i G ^(S) \ { 0} . 

Recall that T^ o T\^ = T o Jj, o J^ o T~^. Set JV := T~^{^) ; is has properties analogous to those 
of ^. Thus, for admissibility, it is enough to prove that 

Jkji ■■= Jk o JI = id ® 3nt{k ®h) : ^'(S x S) ^ ^'(S x E) 
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restricts to an operator J^^h ■ ■^ ~> -^^ ■ This surely holds for .-# = $^(E x E) , case in which 
jY = ^(E X E) = ^(E)®p^(E) . 

In general, ()4.27p may fail even ior h = k . There are many pairs {h, ^) for which Jh o JI = 
id (■, h)r^.h does not leave a subspace .jy := T^^(^) invariant. If, however, (T/j o TJ^) ^ C ^ 

for every h e ^(S) , we are going to say that ^ is diagonally admissible; this is weaker than 
admissible. 

Proposition 4.18. 1. If ./# is a diagonally admissible Banach space continuously embedded in 
^'(E X E) , for every h e ^(E) \ {0} the map T^ : ^'(E x E) ^ ^'(E) restricts to a retract 
Tj^ ; ^ ^ C0,,(.^) . 

2. Suppose, in addition, thaf^CSxT.) is contained densely in ^ . Then'^{T,) is dense in COh{^) ■ 

3. For any h £ ^(S) \ {0}, the family of coorbit spaces COh{^) of all diagonally admissible 
Banach spaces ^ continuously embedded in {#'(E x E) is stable by any interpolation method. 

Proof. 1. We already know from the proof of Proposition 14.171 that CO/i(^) C TJj^(^) , as a 
consequence of the inversion formula; the opposite inclusion follows from diagonal admissibility. Then 
apply the Closed Graph Theorem to conclude that Tj^ £ M[COh{^),.y^] ■ The inversion formula 
shows that this mapping is a retract. 

2. The inclusion ^(E) C QOh{^) follows from Lemma 14.131 and from the monotony of the 
inducing process, so we only need to prove density. 

Let / £ QOh{^) , i.e. F := T^if) £ ^. One has \\ F — Fn ||.^— ^ for some sequence 
{FnjneN C ^(E X E) . Then /„ := || h ||-j?) T|JF„) £ ^(E), because ^(E) = CO [^(E x E)] and 
J#(E X E) is admissible. By the point 1 

II ./ - fn ||co.(.^) = II h ||(-4 II Tt [T,(/) - F,,] ||co,(.^) <c\\F-F„\U^O, 

which proves that ^(E) is dense in COh{ 



3. We need to know that diagonal admissibility is preserved by interpolation; this is obvious from 
the definitions (to be found in j54j ) . It is well-known that the interpolation functors commute with 
retracts so, by point 1, we get 

F [C0,,(^o), COftG^i) ] = CO,, [F(^o), F(^i) ] 

for such functor F and for any diagonally admissible interpolation couple (./^Oj-^i) ■ CH 

We treat now the problem of duality. 

Proposition 4.19. Assume that (^, || • ||^) is a Banach space continuously embedded in $^'(E x 
E)o- and containing ^(E x E) continuously and densely. Assume in addition that .M is diagonally 
admissible and that h £ ^(E) \ {0} . Then one has a canonical identification between COhi^)' and 
CO,, 



Proof. Let us denote by z : ^(E x E) — > ./# the canonical injection. Then the transpose i' : ^'a — >■ 
^'(E X E)^ ^-> ^'(E X E)cr is continuous, where each dual has been endowed with its own strong 
topology; note that .^L is a Banach space. The map i' is also injective, since i was assumed to have 
a dense range; thus we can apply to ^' = ^a the coorbit procedure. 
Let us set ip : CO,, (./#') -^ C0,,(^)' by 

(^(/),5)(s) :=(T„(/),T„(5))(5,,5,), y f e CO,^^'), g e CO,^^) . (4.28) 
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Actually the duality of the r.h.s. is the one between ^' and ^ but, by compatibility, we can use 
the previous notation (•, •)/5]xS) ■ 
One has for all g G CO/i(^) 

l(¥'(/),5)(E)l = l(Th(/),T„(5))(5,,5,)| 

<||T„(/)|U,||T,(5)|U 
= ll/l|co,,(.^') Il5llc0ft(^) , 

which shows both that the functional </'(/) is continuous and that the correspondence / i— > </'(/) is 
contractive. 

Let us show now surjectivity. For /' G CO/i(^)', let us denote by /g its restriction to ^(S) ; then 
J'q G ^'(S) . We need to show that /^ G CO,i(^') , i.e. that T,, (/^) G ^'. For G G ^(S x S) , by 
the choice we made on /' and by the first assertion in Proposition |43B1 (using diagonal admissibility) 
we have 

I (T,(/^) , G)(5,,s) I = I (/^, Tt (G)) I < ci II Tj, (G) Ijco.(^) < C2 1| G U . 

This and the density of ^(S x E) in ^ shows indeed that T/j(/q) G ./#'. By using the extended 
inversion formula it is easily seen that ^ \\h\7^. fA = f . 

Being a continuous linear bijection between two Banach spaces, (p is an isomorphism by the Open 
Mapping Theorem. As a matter of fact, some more work shows that it isometric. D 

4.3 Coorbit spaces of vectors 

Let us fix an element w G H . The family {ti'(s) := 7r(s)*t« | s G S} is a tight continuous frame |21] . 
as a consequence of Hvpothesis l2.1l The constant of the frame is G = || w p; we assume it to be 1 by 
normalizing w . So we have in weak sense 



1 = / d^i{s)\w[s))^w{s)\. (4.29) 

We define <\)^:U^ ^2(S) C ^^(x;) by 

0i„(w) :=: (i>u.w = {7r{-)u,w) = {u,w{-)) , (4.30) 

with adjoint (pl^ : .^2(S) — > H given by 

^lif) - / df,{s)f{s)7r{srw ^ U{f)w . (4.31) 

Jy: 

To show the analogy with the localized mappings T;i = T o J^j of the previous section, we could use 
"H 3 u h^ jw{u) :~ u^w & SSi^X') to write 0^ ~ $ o Jm . The kernel associated to the frame is the 
function p^ : E x I] — ^ C given by 



Pw{s,t) := (w(i),w(s)) = {Tr{t)*w,Tr{s)*w) = ^i„(t),^(s) = (l)ni(s),w{t) , (4.32) 

defining a self-adjoint integral operator P^ = 3ni{pw) in ^2(S). One checks easily that P„, = 0to(/>|„ is 
the final projection of the isometry 0„,, so Pu, [^2 (S)] is a closed subspace of ,^2 (5j) • Since 0|j^,(/)u, = 1, 
one has the inversion formula 

u^ f dfi{t)[(byjiu)]{t)wit) (4.33) 
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and the reproducing formula 4>w{u) ~ P^ [^^(u)], i.e. 

[Mu)] is) = / d^l{t) {w{t),wis)) [0,„(u)] (t) . (4.34) 

Thus ^tu(I]) :— Pu, [^2(S)] is a reproducing kernel Hilbert space with reproducing kernel pw; it is 
composed of bounded continuous functions on E . 

Let us assume, in addition, that the "window" w belongs to the Frechet space Q continuously and 
densely embedded in H. We are going to use the notations and results of section [^31 In particular, 
these results justify the linear mapping (j)w '■ Q' ^ ^'(S) which will be used to pull back algebraic 
and topological structure. 

Definition 4.20. Let {Ai, \\ ■ \\m) &e a Banach space continuously embedded in ^'(E). Its coorbit 
space (associated to the couple (ir^w)) is 

co^iM) := {u e g' I (l>^{u) e M} (4.35) 

with the norm ||w||co„(a4) •= Il0io(") \\m ■ 

Remark 4.21. Since coorbit spaces of vectors are not our main concern, we are not going to develop 
their theory. After suitable adaptations, a lot can be said just by particularizing results from |21j . 
It is also possible to make convenient modifications in developments and proofs contained in the 
preceding section on coorbit spaces symbols, by making the replacement T^ ^^ tpw So let us just 
state the rather obvious fact, that will be used below, that cOu,(A^) is a Banach space continuously 
embedded in Q' . Simple arguments based on the inversion formula and the mapping properties of 
0j„ show that co^[^2(S)] = Ti. , cOtu[^(E)] = Q and co^[$#'(E)] ~ Q' (if Q is not Banach, the second 
and the third examples can be taken in the category of vector spaces) . 

The next result gathers in a single formula the transformations tt^, T^, II and 3nt and will imply 
a general result on boundedness of operators n(/) between modulation spaces. It is a consequence 
of Proposition 14.51 but it is better to give a direct proof. 

Proposition 4.22. 1. For any f G .^2(S) and Wi,W2 E H, one has in B[^2(S)] 

^^oMf)^l^ - 3nt [T^„^,„^ (/)] . (4.36) 

2. If f & ^'(E) and wi,W2 e G , the same identity holds in B[^(E),^'(E)] . 
Proof. 1. We compute for k g ^2(S) and s G E , using (|4.3ip . ()2.5p and the symbolic calculus 

[{KMMJ k] (.s) - (7r(,s)n(/) [q>l^ik)] ,W2) = (n(fc)«;i,n(/)*7r(s)*z«2) 

= / dfi{t)k{t){7T{t)*wi,u{frHsrw2) 

d^{t) k{t) (n ie**f* et) ^1,^2) 

dn{t) k{t) {e*-kf-k et,(f>w2,wi)(^s^ 

= (3fnt[T^„^,„^(/)]fc)(,s). 

2. This can be justified repeating the computation above in weak sense, applied to a "test function" 
I S 5f (E) , using our previous information about the extended objects. One has, with suitable 
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interpretations and also using Remark 14. Ill 



D 



Corollary 4.23. Lei (A^i, || • ||a^i) and {M2, \\ ■ \\m2) ^^ ^^^ Banach spaces continuously embedded 
in ^'(E) and (.-#, || • ||.^) be a Banach space continuously embedded in ^'(E x S) . // 3nt (^) C 
M{Mi,M2), then U[CO^^^^^{.^)] cM[co„,{Mi),co^,iM2)] ■ 

Proof. Assume that / e CO^^ ^ (^) , meaning that T^^^^^ ^^ (/) € ^ . Let also u G cOi„i(A4i), 
thus (pwi (u) £ A1 1 . Applying the assumption, we get 

By (|4.36p . this can be written v = (f)^^ [n(/)] u G A^2 , meaning that Il{f)u G cOtu2(7W2) • 
On the other hand 

l|n(/)u||co„,(A4.) = ll0».[n(/)u]||A,, 

< C ||(/'t«i(w)||A4i= C* ||w||co„,(A1i) ■ 

D 

Besides giving the pair {T-L, tt) satisfying Hypothesis 12. 1[ the formalism benefits from a good choice 
of a space Q. As explained in section [^751 even the trivial choice G = H is fruitful, because of the 
richness of the theory of topological tensor products. In particular it will lead to strict subspaces 
g§)pg = n^pH C n^n, ^(S) C ^2(S) and ^(E x E) C ^2(S x E) (consisting of "trace-class 
elements"). Consequently, the corresponding duals will contain strictly the corresponding Hilbcrt 
spaces. So, even in this case, we have a small space ^(E) playing the role of reservoir of windows 
and a large space ^'(E) as reservoir of "generalized symbols" to play with. But clearly one would 
need better choices. We follow now the approach of [T7] and [H] to show that such better choices 
are possible. 

So let us consider continuous admissible weights A : E x E — > [1, 00) which are 

• bounded along the diagonal: A{s, s) < C < 00 for all s G E , 

• symmetric: A{s,t) — A{t,s) for all s,t G E, 

• satisfying A{s, t) < A{s, r)A{r, t) for all r, s, t G E . 
It is easy to see that 

^A := {if : S X E ^ C measurable | || K \\^^< 00} (4.37) 

is a Banach *-algcbra of kernels with the norm 

ll-ft^lU^^^^ max J esssup / d^i{t){AK){s,t) , ess sup dfi{s){AK){s,t)'> . (4.38) 

I ses Jt, tes Js J 

30 



Picking some (inessential) point r S E one defines the weight a = a,. : S — >■ [1, oo) by a{s) := A(s, r) . 
Fixing also a unit vector wq G "H, we require that the kernel p.^j^ given by (|4.32p be an element of 
s/a ■ Then set Q = Qa,wo -^ {w E H \ 0^q(w) G ^^{T,)} with the obvious norm 



lklle„.™o:=lk™oHll^i(E)=y dtii.s)ais)\[^^,iw)]{s)\. (4.39) 

Proposition 4.24. 1. The space Ga,wo ^s a Banach space continuously and densely embedded in 

n. 

2. Setting Q = Ga,wo, then the space ^(S) := $ {G(S)p'G) is given by 

^(E) ^{he ^2(E) I T^„„,„„(/i) G if^JE X E)} . (4.40) 

Proof. 1. For the Banach space property we send to [31] Prop. 3.1] . The embedding follows from 
Hypothesis 12. 11 from a(-) > 1 and from the bound [0tuo(^)] {■) < D < oo : 

\\w\\n= f M-'^) I [0-0 H] {s)?<d[ dfi{s) a{s) I [cf,^, (w)] (s) \ . (4.41) 

To prove density, it is enough to check that the total family {wo(s) = 7r(s)* wq I ■? £ E } is contained 
in Qa,wo- As a matter of fact, as in [211 (3-9)], it follows easily from the requirement pu,Q G £/a that 

\\Ms)\K^,< a(s)|b™olUA- (4.42) 

If we are not interested in the dependence of s of the " constant" in (|4.42p , much less can be required 
on pu,o ■ For other possible developments we refer to Ch.3 in [21] . 

2. Obviously the weight can be absorbed in the measure: one has .2'^^(E;/i) = ^-'^(E;a/i) and 
■^a0ai^ X E ; /^ (g) //) = ^-^(E X E ; (afi) {a^)) , so it is enough to consider the case A{r, s) = 1 for 
every r, s G E . 

By the first computation of the proof of Theorem 14.41 we have 

^0^0. -0 [*(" ® "")] •= ^ {4'u.v^4'wo,wo) = 4'u,wo®4'v,wa = 4>wa{u) ® '/>too (w) , 

which implies that T^^ ^ o$ = 4iwo®4'wo ■ Since ^^(E x E) can be seen as the completed projective 
tensor product ^i(E)®p^^(E) (by [13 Ch.46]) , the resuh follows easily. D 

So, in a certain sense, Qa.wo is a coorbit space of vectors cOwa [-S^i(E)] and the reservoir of symbol- 
windows associated to Qa,wo is also a coorbit space. For A = 1, one could call Qi^wo the Feichtinger 
space of vectors and the resulting ^(E) = CO,^^^^^ [Ji'^{T, x E)] the Feichtinger space of symbols, 
both associated to the family 7r(-) . 

Remark 4.25. Using the relation T^^ ^ o $ = (/)^,j (g) cj)^^ one can also prove, as a generalization 
of point 2. of the Proposition, identities of the form 

$ [co^,i(>fi)®pCo„,(7U2)] = CO0„^„J>li§pAl2] , (4.43) 

for vectors wi,W2 and Banach spaces A^i, AA-z ■ 
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